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I Abstract. We consider an urn model leading to a random walk 

■ that can be solved explicitly in terms of the well known Jacobi 

I polynomials. 

Ph. 
» 

1. Urn models and orthogonal polynomials 

There are two simple and classical models in statistical mechan- 
^ I ics which have recently been associated to very important classes of 
orthogonal polynomials. The oldest one of this models is due to D. 



OO ■ Bernoulli (1770) and S. Laplace (1810), while the more recent model is 
due to Paul and Tatiana Ehrenfest (1907). While both of these mod- 
I els are featured in very classical texts in probability theory, such as 
• [F], the connection with orthogonal polynomials is of much more re- 

O ■ cent vintage. In fact, the polynomials in question due to Krawtchouk 

and Hahn had not been recognized as basic objects with rich prop- 
erties till around 1950. For a few pertinent and useful references see 
[Al [AARl [Chi m [El [Gil HLMVl iKl IKMcGl] . 



From the comments above one could get the impression that the 
relations between orthogonal polynomials -specially some well known 
classes of them- is only a matter of historical interest. Nothing could 
be further from the truth: there are several areas of probability and 
mathematical physics where recent important progress hinges on the 
connections with orthogonal polynomials. 
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The entire area of Random Matrix theory starts with the work of 
E. Wigner and F. Dyson and reaches a new stage in the hands of M. 
Mehta who brought in the power of orthogonal polynomials into the 
picture. 

In the area of Random growth processes the seminal work of K. 
Johansson depends heavily on orthogonal polynomials , specifically La- 
guerre and Meixner ones, in [j]. 

The connection between birth-and-death processes and orthogonal 
polynomials has many parents but the people that made the most of it 
are S. Karlin and J. McGregor, see |KMcG| . We will have a chance to 
go back to their work in connection with our model here. One should 
remark that the ideas of using the spectral analysis of the corresponding 
one step transition matrix have been pushed recently in the case of 
quantum random walks, an area where physics, computer science and 
mathematics could make important contributions. See [CGMVl IKo| . 

The study of the so called ASEP (asymmetric simple exclusion pro- 
cesses) going back to F. Spitzer, see [SJ, and very much connected with 
the work of K. Johansson mentioned earlier, has recently profited from 
connections with the Askey- Wilson polynomials. All of this has impor- 
tant and deep connections with combinatorics and a host of other areas 
of mathematics. There are many other examples that one could men- 
tion, but we just add here the study of nonintersecting or non-colliding 
random process which goes back to F. Dyson. 

There are lots of interrelations among these areas. For one exam- 
ple: the Hahn polynomials that were mentioned in connection with 
the Bernoulli-Laplace model were studied by Karlin and McGregor in 
connection with a model in genetics due to Moran, see |KMcGl| . They 
have also been found to be useful in discussing random processes with 
non-intersecting paths, see [G|. 

All of these areas are places where orthogonal polynomials have 
been put to very good use. For a very good review of several of these 
items see [K]. Orthogonal polynomials of several variables, as well as 
matrix valued orthogonal polynomials have recently been connected to 
certain random walks. For two samples see |G2l IG3| . 



2. The Jacobi polynomials 

The classical Jacobi polynomials are usually considered either in 
the interval [—1, 1] or, as will do, in the interval [0, 1] 

These polynomials are orthogonal with respect to the weight func- 
tion 
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W{x) = - xf. 

Here we assume that a,P > —1, in fact it will be assumed throughout 
that Q, are non-negative integers. 

These polynomials are eigenfunctions of the differential operator 

cP d 
x{l - x)— + {a + l + x{a + 13 + 2)) — 
ax^ ax 

a fact that will not play any role in our discussion but which is crucial 
in most of the physical and/or geometrical applications of Jacobi poly- 
nomials. These applications cover a vast spectrum including potential 
theory, electromagnetism and quantum mechanics. 

Neither the orthogonality, nor the fact that our polynomials are 
eigenfunctions of this differential operator are enough to determine 
them uniquely. One can multiply each polynomial by a constant and 
preserve these properties. We chose to normalize our polynomials by 
the condition 

Qn(l) = 1- 

For us it will be important that these polynomials satisfy (in fact 
are defined by) the three term recursion relation 

xQn{x) = AnQn+l{x) + + CnQn-l{x) 

with Qo — 1 and Q-i = 0. 

The coefficients A^jB^, Cn given by 

{n + (3+l){n + a + (3 + l) 
" (2n + a + /5+l)(2n + a + /? + 2)' - 
^ _^ n{n + (3) (n + l)(n + /j + l) 
2n + Q; + /3 2n + Q; + /3 + 2 ' 

C ^ n{n + a) 

" (2n + a + /3)(2n + Q; + /3+l)' - ' 

The coefficient B„ can be rewritten as 

_2n{n + a + l3+l) + {a + l)(3 + a{a + l) 
" ~ (2n + a + /3)(2n + a + /3 + 2) 

which makes it clear that, along with the other coefficients, it is non- 
negative. 
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Since we insist on the condition (5„(1) = 1 we can see, for instance 
by induction and using the recursion relation, that 

An + Bn + Cn = 1- 

There are, of course, several explicit expressions for the different 
variants of the Jacobi polynomials and they can be used for instance 
in computing the integrals that appear in the last section. 

The normalization above is natural when one thinks of these poly- 
nomials (at least for some values of a, (3) as the spherical functions 
for some appropriate symmetric space, and insists that these functions 
take the value 1 at the North pole of the corresponding sphere. The 
simplest of all cases is the one with a = P = when one gets the 
Legendre polynomials and the usual two dimensional sphere sitting in 
M^. The reader may want to see |VK| . 

The fact that the coefficients are nonnegative and add up to one 
cries out for a probabilistic interpretation of these quantities. This is 
the purpose of this paper. We have not seen in the literature concrete 
models of random walks where the Jacobi polynomials play this role. 

3. The model 

Here we consider a discrete time random walk on the non-negative 
integers whose one step transition probability matrix coincides with the 
one that gives the three-term recursion relation satisfied by the Jacobi 
polynomials. 

At times t = 0,l,2,.... an urn contains n blue balls and this deter- 
mines the state of our random walk on Z > 0. 

The urn sits in a "bath" consisting of an infinite number of red 
balls. The transition mechanism is made up of a few steps which are 
described now, leaving some of the details for later. 

In the first step a certain number of red balls from the surrounding 
bath are mixed with the n blue balls in the urn. 

In the second step a ball is selected (with uniform distribution) from 
among the balls in the urn. This "chosen ball" can be blue or red. In 
either case an experiment is performed in a parallel world, using an 
appropriate "auxiliary urn", to determine if this chosen ball will retain 
its color or have it changed (from red to blue or viceversa). 

Once this is settled, and the possible change of color has taken 
place, the main urn contains the initial n balls plus a certain number 
of balls taken form the bath in the first step, and we are ready for the 
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third and last step. This final step consists of having all red balls in 
the urn removed and dropped in the bath. 

The state of the system at time t + 1 is given by the number of blue 
balls in the urn after these three step are completed. Clearly the new 
state can take any of the values n — l,n,n + 1. 

A more detailed description of the three steps above is given in the 
next section. 

4. The details of the model 

If at time t the urn contains n blue balls, with n — 0, 1,2, .... we 
pick 

n + a + (3 + l 

red balls from the bath to get a total of 2n + a + + 1 balls in the urn 
at the end of step one. 

We now perform step two: this gives us a blue ball with probability 

n 

2n + a + l3+l 

and a red ball with probability 

n+a+p+1 
2n + a + l3+l 

If the chosen ball is blue then in a "auxiliary urn" with n blue 
balls we throw in a blue balls and n-\- (5 read balls, mix all these balls 
and pick one with uniform distribution. We imagine the auxiliary urn 
surrounded by a bath of an infinite number of blue and red balls which 
are used to augment the n blue balls in this auxiliary urn. 

The probability of getting a blue ball in the auxiliary urn is 

n-\- a 
2n + a + l3 

and if this is the outcome the "chosen ball" in the main urn has its 
color changed (from blue to red). If we get a red ball in this auxiliary 
urn then the chosen ball retains its blue color. 

On the other hand, if in step two we had chosen a red ball then in 
a different "auxiliary urn" with n blue balls we throw in a + 1 blue 
balls and n + /3 + 1 red balls. This auxiliary urn is also surrounded by 
a bath of an infinite number of blue and red balls. 
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These balls are mixed and one is chosen with the uniform distribu- 
tion. The probability that this ball in the auxiliary urn is red is given 

by 

n + (3+l 
2n + a + p + 2 

and if this is the case the chosen ball in the main urn has its color 
changed (from red to blue). Otherwise the chosen ball retains its red 
color. 

Notice that the chosen ball in the main urn has a change of color 
only when we get a match of colors for the balls drawn in the main and 
an auxiliary urn: blue followed by blue or red followed by red. 

In either case once the possible changes of color of the chosen ball 
in the main urn has been decided upon, we remove all the red balls 
form the main urn. 



We see that the state of the system goes from n to n — 1 when the 
chosen ball is blue and then its color gets changed into red. This event 
has probability 



n 



2n + a + P+1 

multiplied by 

n + a 



2n + a + p 

Observe that this coincides with the value of C„ in the recursion 
relation satisfied by our version of the Jacobi polynomials. 

The state increases from n to n + 1 if the chosen ball is red and its 
color gets changed into blue. This event has probability 

n + a + f3+l 

2n + a + /3+l 

multiplied by 

n + P + 1 
2n + a + P + 2 

Observe that this coincides with the values of An given earlier. 

As we noticed earlier, when the chosen ball is blue and the ball in 
the corresponding auxiliary ball is red then the chosen ball retains its 
color. Likewise if the chosen ball is red and the ball in the corresponding 
auxiliary urn is blue then the chosen one retains its color. In either case 
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the total number of blue balls in the main urn remains unchanged and 
the state goes from n to n. 

Recall the basic property of the coefficients v4„, C„, namely 

+ Bn + Cn = 1 

This shows that the probabilty of going from state n to state n is 
given by 

In summary we have built a random walk whose one step transition 
probability is the one given by the three term relation satisfied by our 
version of the Jacobi polynomials. 

5. Birth-and-death processes and orthogonal polynomials 



A Markov chain with state space given by the non-negative integers 
and a tridiagonal one step transition probability matrix P is called a 
birth-and-death process. Our model given above, clearly fits in this 
framework. 

One of the most important connections between orthogonal poly- 
nomials and birth-and-death processes, such as the one considered here 
is given by the Karlin-McGregor formula |KMcG| . 

If the polynomials satisfy 



TT,; 



-j / Qi{x)Qj{x)W{x)dx = S, 







one gets the following representation formula for the entries of the 
powers of the one-step transition probability matrix 

(P").^. = TT- [ x''Qi{x)Qj{x)W{x)dx. 







This compact expression gives the solution to the dynamics of our 
random walk and allows for the study of many of its properties. 

In the case of our version of the Jacobi polynomials the squares of 
the norms of the polynomials Qi are given by 

r(2 + i)r(2 + « + i)r(/? + i)2 



T{i + (3+ l)T{i + a + P + l){2i + a + P + l) 



In our case when a, [3 are assumed to be nonnegative integers this 
expression can, of course, be written without any reference to the 
Gamma function. 
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We close this paper by recalling how one can compute in the case 
of our transition matrix P its invariant (stationary) distribution, i.e. 
the (unique up to scalars) row vector 

TT = (7ro,7ri,7r2, . . .) 

such that 

TtP = TT. 

It is a simple matter of using the recursion relation for the polyno- 
mials Qi to show that the components tTj are given, up to a common 
multiplicative constants by the inverses of the integrals 

/ Q'l{x)W{x)dx. 
Jo 

mentioned above. This justifies the notation TTj for these two apparently 
unrelated quantities, and in our case furnishes an explicit expression 
for an invariant distribution. 



AN URN MODEL ASSOCIATED WITH THE JACOBI POLYNOMIALS 9 



References 

[A] Askey, R. Evaluation of Sylvester type determinants using orthogonal 
polynomials, Advances in Analysis, Proceed. 4th international ISAAC 
Congress, ed. H.G.W. Begehr et al. World Scientific, Singapore, (2005), 
1-16. 

[AAR] Andrews, G., Askey, R., and Roy, R., Special functions. Encyclopedia of 
Mathematics and its applications, Cambridge University Press, 1999. 

[CGMV] Cantero, M.J. , Griinbaum, F. A. , Moral, L. and Velazquez, L., Matrix 
valued Szego polynomials and quantum random walks, larXiv:0901. 22441 
(2009) 

[Ch] Chihara, T., An introduction to orthogonal polynomials, Gordon and 

Breach Science PubHshers, 1978. 
[DS] Diaconis, P. and Shahshahani, M., Time to reach stationarity in the 

Bernoulli-Laplace diffusion model, Siam J. Math. Anal. 18, 208-218, 1987. 

[E] Ehrenfest, P. and Eherenfest, T. , Uber zwei bekannte Einwande gegen das 
Boltzmannsche H-Theorem, Physikalische Zeitschrift, vol 8, 1907, 311- 
314. 

[F] Feller, W., An introduction to Probability Theory and its applications, 
vol 1, 3rd edition, Wiley 1967. 

[G] Gorin, V. , Non-intersecting paths and Hahn orthogonal polynomial en- 
semble, arXiv:0708.2349 17 Aug 2007 

[Gl] Griinbaum, F. A., Random walks and orthogonal polynomials: some chal- 
lenges, in Probability, Geometry and Integrable systems, Mark Pinsky and 
Bjorn Birnir editors, MSRI publication vol 55, 2007, pp. 241-260 , see also 
arXiv math PR/0703375 . 

[G2] Griinbaum, F. A. , The KarHn-McGregor formula for a variant of a discrete 
version of Walsh's spider, .J. Phys. A, Sep 2009. 

[G3] Griinbaum, F. A. , The Rahman polynomials are bispectral Sigma 3 , 
(2007) 065. 

[ILMV] Ismail, M.E.H., Letessier, J., Masson, D., and Valent, G., Birth and death 

processes and orthogonal polynomials. Orthogonal Polynomials, P. Nevai 

(editor) Kluwer Acad. Publishers, 1990. 
[J] Johansson, K. , Shape fluctuations and Random Matrices, Comm. Math. 

Phys. 209, 437-476, (2000) 
[K] Kac, M., Random wak and the theory of Brownian motion, American 

Math. Monthly (1947) 54, 369-391. 
[KMcG] Karlin, S., and McGregor, J., Random walks, Illinois J. Math. 3 (1959), 

66-81. 

[KMcGl] Karlin, S., and McGregor, J., The Hahn polynomials, formulas and ap- 
plications, Scripta Math. 26, 33-46. 

[Ko] Konno, N. , Orthoogonal polynomials induced by discrete-time quantum 
walks in one dimension, arXiv 0903.4047 24 Mar 2009. 

[K] Koning, W. , Orthogonal polynomial ensembles in probability theory. 
Probability Surveys, vol. 2 (2005) 385-447. 

[S] Spitzer, F. , Interaction of Markov processes. Advances in Mathematics 5, 

246-290 (1970). 

[VK] Vilenkin, N., and Klimyk, A., Representation of Lie Groups and Special 
functions, vol.3, Kluwer Academic, Dordrecht, MA, 1992. 



10 F. ALBERTO GRUNBAUM 

Department of Mathematics, University of California, Berkeley, CA 94720 



